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Summary 

From  research  completed  with  23  trainee  sections  at  the  Naval  CX3S  in 
Nmvport,  data  are  presented  resarding  the  in-training  validity  of  peer  nom¬ 
inations^  as, ib  is  aliected  by  three  variables j  the  period  of  time  the 
group  has  spent  together]  the  nature  of  the  set  jiyen„ J..e.,  “for  research 
purpeses”  or  “lor  adrra.ni3trutive  pur-j.-oscs"]  and,  the  quality  or  character¬ 


istic  to  be  evaluated  by.  the  noinin.ator  in  making  his  nominations ,  The 
criteria  utilised  were:  pass- fail,  final  academic  average,' and  final 
military  aptitude  grade.  The  following  major  findings,  are  reported; 

1.  Depending  upon  the  criterion  utilized,  different 
fonns  yield  differential  validity  in  prediction. 

2.  All  i.:rms  show  a  tendency  to  increase  in  their  corre¬ 
lation  v/ith  acadci;ac  performance  from  stage  to  stage. 

3«  Irrespucti'v e  oi  tne  suage  at  ’.-hich  adj.'dnistered,  all 
forms  show  a  generalized  si...;niricarice  in  the  prediction  cf  the 
.military  aptitude  gra  .:e  assigned  by  superiors. 

ihe  for;;;  '..'hich  bfst  predicts  the  pass— fail  ..nd  aca— 
deinic  criteria  is  the  one  re.-iuiring  no:ain.:tions  on  "probability 
of  success  in  003";  the  significance  of  this  prediction  is 
found  at  every  st'.ige  of  adiiiinistr-ation  ind  for  both  sets. 

5.  bhile  different  fqr;as  show  sig.nificant  differences  in 
\.ilidity  ag.iin_t  various  criteria,  taere  is  no  general  diap,.irily 
between  tne  validity  of  fonas  administered  under  the  "research" 

S.O  agaiiCai,  the  ’'administrative"  set,  although  certain  inter¬ 
actions  are  found. 


In  keeping  with  the  data  on  reliability  reported  earlier,  it  is  con¬ 
cluded  here  that-depending  upon  the  p'urpose  for  \vhich  intended— an  early 
peer  ncraination  vdll  yield  an  adequate  ap-j-roxiraation  to  the  prediction 
obtained  from  later  ratings .  This  is  of  pai't.icular  importance  in  light 
of  the  marked  tendency  for  certain  fonns  to  be  progressively  loaded  with 
an  academic  performance  factor.  The  full  practical  implications  of  these 
findings  must  be  tempered  until  validities  are  established  against  a  post- 
tra.  ning  criterion  emphasizing  field  performance  characteristics. 


I.  Introduction  ■  ■ 

This  is  the  second  of  a  series  of  reports  to  deal  with  a  lar/'O- 
scale  study  of  peer  ratines  completed  at  the  U.  S.  Naval  School, 

Officer  Candidate  (OCS)  in  Newport,  ilhode  Island,  during  the  sumner 
and  fall  of  1955. 

As  has  been  noted  in  the  preceding  report  (3),  this  study  repre¬ 
sented  an  expansion,  rather  than  a  replication,  of  the  earlier  work 
in  this  Sj.'here  done  at  Newport  by  the  American  Institute  for  ’itesearch 
under  Navy  Contract  Nonr  890(0l) .  Vihile  the  area  of  concern  of  the 
current  project  was  soiaev/hat  more  circumscribed  than  that  of  the 
previous  project,  v/e  are  appreciative  of  tlie  basic  data  available  to 
us  from  the  work  this  group  had  already  completed. 

In  si.:;,  lest  practical  terms,  the  reject  was  conceived  to  eventuall 
provide  more  infornution  reg.arding  the  j.; 'plication  of  peer  ratings — 
Specifically,  "peer  nominations" — as  a  supplemental  screening  de\'ice 
in  the  0C5.  Alth  lurh  this  issue  v.'ill  be  touched  upon  here,  the  final 
proj.;ci,  n.-port  will  ss-rve  is  l.lio  vehicle  i’./r  ;  liiore  co;ii;  reheirm-ve 
delineation  of  the  relevant  iiiiulicaticns  along  this  line. 

The  research  objectives  of  this  study,  basically,  were  to  determine 
the  reliability  and  validity  of  peer  ratings  under  various  instructional 
sets  and  time  exposures.  In  the  first  report  (3),  the  reliability  of 
these  me.asures  was  considered.  Nov/  we  turn  attention  to  the  data 
available  v/ith  regard  to  the  validity  of  tiie  peer  rating  forms  in  pre¬ 
dicting  in-ti-aining  criteria.  Certain  of  the  answers  regarding  more 
ultimate  validity  must  necessarily  await  the  establislmient  of  post- 
training  criteria. 


In  practice,  the  so-eallsd  peer  rating  involves  each  ('roa^j  member's 
emluatipn  of  his  peers  on  some  recognizable  quality  or  set  of  charac¬ 
teristics  which  are  taanifested  directly,  or  inferrable  indirectly,  from 
day-to-day,  personal  interactions.  Such  individual  evaluations  are  then 
integrated  into  a  conposits  score  reflecting  each  person's  st_tnding  in  his 


group.  The  advantage  of  this  technique  apy-ears  to  rest  in  its  ability  to 
yield  unique  supplementary  data  drawn  froiri  intimate  contact  among  the 
personnel  involved. 

Peer  rating  procedures  have  alrea:]]/  deiuonstrated  a  relatively  high 
order  of  predictability  against  various  performatico  criteria,  vdth  a 
substantial  nu-iiber  of  railitary  groups,  (s.g.,  k,  6,  ?,  B,  11,  12,  13, 

14,  15).  It  may  be  noted,  too,  that  the  greatest  development  of  the 
peer  ratings  has  taken  place  vrithin  ttio  military  services  (2).  Several 


questions,  rsia'^in  to  be  .unuvjereii,  houever,  before  optiitium  utilization  of 
peer  ratings  ra..y  be  effected. 

III.  beatoment  of  the  Problem 

Three  core  p-roblouiO  may  be  specified  for  consideration  at  Lhis  stage. 
These  involve,  first,  the  length  of  ti:no  which  the  group  juust  have  spent 
together  before  peer  ratings  will  ap-^roxiiaate  maximized  validity  and 
reliability!  second,  tua  presence  of  any  differential  effects  on  validity 
and  reliability  accruing  frouithe  use  of  peer  ratings  with  a  "research" 
set  as  against  those  with  a  "real"  set|  and,  finally,  the  variations  in 
validity  and  reliability  which  may  be  attributable  to  the  nature  of  the 
quality  on  vihich  the  rater  is  instructed  to  rate  the  ratee.  As  has  been 
suggested,  this  report  will  confine  itself  to  data  bearing  on  the  in-  . 
training  validity  aspect  of  these  problems.  ■ 


IV.  Subjects  find  Setting 

Throu/'h  the  Joint  cooperation  of  the  Office  of  Naval  Research,  the 
Bureau  of  Naval  Personnel,  and  the  Naval  0C3  itself,  the  entire  input  of 
OCS  Class  23  was  made  available  for  this  study.  The  sampl.e  entered  brain¬ 
ing  in  July  of  1955  and  consisted  of  23  sections  numbering  about  30  men 
eachj  there  is  no  reason  to  supooce  that  assigruucat  to  these  suctions  was 
on  anything  other  than  a  random  basis.  The  total  N  available  for  study 
exceeded  700,  at  the  beginning  of  this  project. 

The  program  at  the  003  is  of  sixteen  weeks'  duration,  with  an  orien¬ 
tation  week  introduced  before  the  actual  onset  of  the  training  cycle. 
During  this  one-week  period,  student  personnel  are  assigned  to  sections, 
receive  books  and  clothing,  take  classification  tests,  receive  orienta¬ 
tion  lectures,  but  do  not  attend  fonaal  classes,  as  such, 

Except  for  a  small  minority  drawn  from  the  fleet— in  this  class 
numbering  fewer  than  — all  of  the  students’  are  -raauates  of  four  year 

college  i)ro{;ram3.  The  :nean  a'-,e  of  this  class  ■  j.->  22  years  v.lth  only  a 
minimal  dispersion  above  this  figure. 

Students  at  the  OCS  are  selected  accorUin/-  to  rigorous  mental  and 
physical  standards,  nil  arc  voluntei;rs,  and  must  a;;ruo  to  roimdn  on 
active  duty  as  officers  for  three  years  follovdng  the  successful  conclu¬ 
sion  of  training. 

V.  Instr’iments , 

The  previous  work  of  Gaci,  Vallance,  and  Glickman  (9)  established 
several  points  which  bore  upon  the  selection  of  instruments  for  this  study. 
Their  research  indicates  that  "...  ratings  by  peers  based  on  either  the 
behavior  at  OCS  or  projected,  future  behavior  are  equally  reliable  ..." 
(9,  p.  11)  j  in  additic’ii,  they  report  that,  "The  technique  vMch  requires 
selection  of  the  upper  and  lov;er  segments  appears  to  have  as  satisfactory  . 


reliability  as  any  of  the  other  tested  techniquuo  ,  .  (9,  r.  li)i 

finally,  they  note  that  the  order  of  presentation  which  yiuias  the  lowest 
correlation  between  forms  is  "future  officer"  followed  by  "0C3  behavior" 

(9,  P.  12),  The  pertinence  of  these  findings  to  the  issue  of  reliability 
has  already  been  noted  in  the  first  report  in  this  series  (3,  p.  8), 

Four  key  sociometric  forms  of  the  peer  nomination  variety  v/ere 
utilised,  based  upon  the  research  cited  above  (9),  a  primary  fona 
calling  for  nominations  on  "success  as  a  future  Naval  Officer"  (FO)  was 
administered  to  all  sections.  This  form  was  s.^en  to  be  of  partlculiir 
iTOrth  in  its  likely  prediction  of  more  distant,  fleet  perfonaance  criteria. 
In  addition  to  this  primary  fon.i,  each  section  received  one  of  three  so- 
called  secondary  foniis,  i.e.,  "leafiership  qualities"  (bO),  "interest  in 
and  enthusiasm  for  the  Nuval  dervice"  (lb),  and  "iirobability  of  success 
in  OCS"  (OC),  The  selecti'in  of  these  forms  rested  uj-on  a  need  to  tap 
those  ch.-iraeteriutics  which  ;aighL  reiatu  to  botl-.  iii-trainin  ;  ;nd  ;jost- 
trainiiiF  perior:.ur.::e — i.e.,  int^^ri-crsonal  fruaiities,  motivation,  and 
abilit;/  h..ving  eviaent  relevance  to  QJb  pcri  irmince. 

Cuttin.;  across  this  p-attern,'  a|>  roximately  iislf  t',i<;  sections  received 
a  "research"  set  '•dth  the  ezjjlioit  point,  .ip,;ear'ins  on  their  peer  nomina¬ 
tion  ior..;s,  that  "The  results  of  these  ratin;'S  art;  to  bo  used  for  research 
psirposes  only  and  will  not  affect  your  Navy  career."  The  other  sections 
were  riven  equ;iliy  explicit  instructions  that  "The  results  of  these 
ratings  a-.y  bo  used  for  aclainistrativo  purposes,"  This  split  in  treat¬ 
ment  was  designed  to  provide  data  on  the  differential  reliability  and 
validity  resuluing  from  adiainistration  under  a  "research"  set  as  against 
an  "adiTiinistrative"  set,  :  ' 
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In  all  there  were  eight  possible  forms,  i.e.,  four  characteristics 

.1 

to  be  rated  times  two  sets.  In  apijendix  A,  form  FO-HO  is  reproduced 
as  an  illustration  of  the  format  followed  with  all  forms,  dince  this 
•was  varied  only  slightly  to  accomraodate  alternative  instructions,  the 
reader  nay  viev.’  this  as  an  example  of  the  general  instructions  aji/lied. 

As  vail  be  noted,  all  of  the  forms  required  five  "high"  and  five 
"lov.'"  nominations  in  order  of  preference.  Each  of  f.ie  subjects  was 
provided  v»’ith  a  c  -j.';i;l';te  al  di  footical  roster  of  his  serid  oni'utes  every 
time  ho  was  requii-ed  to  comiilete  .a  foria.  The  princiinl  investigator  was 
the  sole  adniinistrafor  of  the  forms  for  .til  sectiuns  at  .ill  times, 

VI.  Study  design 

The  ultimate  design  of  the  i5t-.idy  is  reflected  in  Table  1.  it 
v/ill  be  seen  that  tlie  23  sections  were  divided  into  six  blocks  of  four 
sections  each,  except  for  on.'S  block  which,  of  no-cossity,  i.'.-.s  limited 
to  three  sections,  oecti-sns  v;cre  sissign--d  to  block.s  on  a  rotation 
basis  fro.  1  the  five  coa.j.inies  in  the  .>ec’-jnd  bait  lii  >n  '..'hich  comprised 
the  class,  i.e.,  Hov;,  Jig,  King,  Love,  Like.  J-uc;,  differences  as 
might  e;:ist  between  ';.)!.;p.anies  '...re  th.ja  re.-tfii',‘.A:d  in  ,iiL.ir  conceivable 
ability  t.5  contai.iin-ite  the  study  design. 

Once  having  been  as sign. ;d  to  a  .given  block,  the  treatment  of  any 
given  section  was  identical  through  training.  Three  major  .adminis¬ 
trations  of  these  forms  was  carried  on  durin.g  the  trainin.g  cycle:  uhe 
first  occurred  (iurir;.'  t^e  so-caxieu  -orient  at  lew  wv.eM" — re..er.ed  uo 
hereafter  .as  the  "0"  week—after  the  subjects  had  been  to;;other  in 
their  respective  sections  for  four  to  five  days;  at  the  end  cf  the  third 
week  of  training  ("3"  week);  and,  at  the  end  of  the  sixth  week  of 
training  ("6"  -week).  The  design  .appearing  in  Table  I  was  replicated, 
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■  ■  TABLE  I 

Study  Design/:'  Indicating 
Foinis  Used  and  Sections  to  VMch  Applied 


Section  «illocation 


Forms'"-"' 

Set 

Research  (RO) 

.idiainistrative  (AU) 

"Future  Officer"  (FO) 

"Interest  w  Enthusiasm"  (IE) 

H-1,  J-1,  L-1,  M-1 
■  4/ 

H-2,  K-1,  L-2,  M-2 

B/ 

"Future  Officer"  (FO) 

"Success  in  0C3"  (OC) 

J 

H-3,  11-4,  J-4,  K-4 

c/ 

H-5,  J-3,  K-5  . 

D/ 

"Future  Officer"  (FO) 

"Leadership  Qualities"  (LQ) 

’  J-2,  K-2,  L-3,  w-3 

E/ 

j_3^  K-3,  L-4,  H-4 

■"'This  design  was  applied  at  the  end  of  the  orientation 
week,  third  week,  sixth  week,  and—except  for  the 
ondssion  of  the  secondary  forms — the  thirteenth  vreek, 

-"-"-Uote  that  each  section  received  tvo  forms. 

/Signifies  group  code  designation. 
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therefore,  a  total  of  three  ti:nes.  at  the  end  of  the  thirteenth  vreek 
of  training,  another  aciiidnistration  of  fonas  v/aa  raacie,  but  this  last 
tiirio  only  the  primary,  "future  officer,"  form  v/as  uaed.  In  all  other 
respects,  the  desic-n  was  identical  for  the  latter  administration. 

VII.  dcoring 

Following  the  pattern  utilized  in  several  studies  elsewhere  (e.g.,  4, 
a  direct  woightin-'  procedure  was  applied  to  derive  peer  n''<i:iinition  scores. 
The  highest  nominee  was  awardod  a  plins  5,  the  next  highest,  ...  jjIus  4, 
and  so  on  through  the  five  "lii'.;h3"j  similarly,  the  lowest  nominee  v;as 
Assigned  a  minus  5,  the  next  lo'.  cst,  .1  minus  4,  an.i  s-.  on.  .in  al(;ebraic 
suiT.  war.  then  obtained  for  e-ach  subject  .'ind  divided  by  the  N  of  the  group 
minus  1,  since  no  subject  m  .y  no..:dn  ite  hliself.  This  results  in  an 
average  score  rwingin,:*  on  a  c.j.utinuum  froin  ..'lus  five  to  miinus  five.  To 
remove  the  minus  sigu,  a  c.-.n.:b  int  of  p  v;a.s  a.ided  to  this  sc.ara;;  t)\.; 
res.iltant  value  wi.:.  ih.ni  multii.lied  by  10  in  ord.:;r  to  per.ilt  ti.e  use  of 
a  tv.'o  <.iigit  coor.3  v;ithn...t  tivu  inti;rven.ln,:,  uecisiul  int.  '..'here  a  subject 


had  .'.'.n  avcra;;o  rav;  value  of  irdnus  5,  and  hence  a  score  of  00,  he  was 
arbitrarily  viven  a  score  of  01,  .li'tur  th.--  constant  hui  been  added  and 
the  i.iultiplic.vtion  had  taken  .  lice.  .it  the  other  en(i  of  the  range,  the 
plus  5  subject  '..'a.-;  riven  a  score  of  99,  rather  than  100. 

The  distribution  arising  fi-jm  this  procedure  ha.;  noruial  ch.irac- 


terieticc  v;ith  a  range  fror.i  1  to  99,  a  mean  of  50,  and  a  standard 
deviation  aioproxiniating  10,  for  the  total  population  of  the  study. 

Vfhile  this  score  jtuiy  be  seen  to  have  certain  features  of  a  standard 
score,  it  does  not  tend  to  obscure  section  differences  so  much  as  does 
the  standard  score,  Furtheriaore,  this  score  does  not  pres uitic  the 
ho-mogeneity  of  ch..racteristics  from  section  to  section  v;hich  is  assumed 
under  a  generalized  standa.-d  JCO.'’e  transforjaation. 
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VIII,  Heliabilitj^  of  Measures 

In  determining  the  reliability  of  peer  nomination  data,  two  liiajoi 
approaches  my  be  followed:  first,  calculation  of  internal  consistency 
through  correlation  of  scores  obtained  by  an  o^id-evun  split  of  raters 
corrected  by  the  Spearman-Brosm  foriiiulaj  second,  calculation  of  consis¬ 
tency  over  tirrie  through  repeat  uiainistration .  The  previous  reiiort  in 
this  series  (3)  covers  the  reliability  obtained  for  all  forms,  under 
both  sets,  at  various  time  levels,  using  both  the  single-stage  and 
longitudinal  approaches , 

Table  II  reports  the  corrected  Sj,'lit-half  relifibility  coefficients 
yielded  from  the  eight  peer  nomination  fcr.iis' utiliaccl,  at  various  points 
in  the  life  cycle  of  relevant  groups.  It  will  be  seen  that  the  relia- 
^•biiities  in  the  first  colu.-m,  for  all  foriAS,  ap. iroxl'iute  .90 — even 
though  the  Suctions  livd  been  com-.r-isv^d  only  four  or  five  days  before. 

.The  gaip,  .13  regards  high-r  reliabilities,  is  yre-doer,  b.it  not  signifi¬ 
cantly  so,  as  one  proceeds  to  later  time  levels; 

h’ith  regard  to  repeat  reliability,  the  findin.',.;  of  the  first 
rep’Ort  show  -a  high  se:ruential  intorcorrelation  of  scores  secured  from 
the-  same  for:.i  it  different  time  levels;  a  iurticulariy  notev/orthy 
relationship  (about  ,90)  was  found  between  third  and  si:cth  week  scores 
for  -all  fonas.  It  ',.'oald  appear  that  the  earlier  rc.idin.:;5  niaj'-  be  taken 
as  a  ro  .somble  apprceciraation  of  the  later  ones , 

Firiilly,  no  significant  difference  v/as  discerned  in  either  the 
single- stage  reliability  or  repeat  reliability  of  scores  obtained  from 
coi'iparable  foruis  atisiiniatered  under  the  “research"  as  against  the 
’•administrative"  set. 
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TABLE  II 


Corrected  liplit-Half  Reliabilities  of 
Eight  Peer  Nomination  Forms  at 
Various  Stages  of  Training 


Week  in  Training 


Forms 


Orientation 


FO-RO 


.94 

.97 

92 

.94 

.97 

96 

- 

96 

1— =r,-  r  sst 

Tliird 

Sixth 

Thirteenth 

Week 

Week 

Week 

lE-RO 


lE-AU 


LQ-RO 

.93 

.96 

. . -  ■■  -  ■ 

.96 

32 

32 

31 

LQ-AU 

.94 

.97 

.98 

32 

32 

32 

OC-RO 

.93 

.98 

.99 

32 

31 

31 

OC-AU 

.89 

.97 

.98 

32 

32 

31 

■•^The  number  below  each  coefficient  indicates 
the  N  uj)on  which  it  is  based. 


T  Y  Ho'**  oirt-wT  *1 4*  n  <-v»n  *-1.  *1  T  4-  ’ti' 

Before  reporting  on  the  finding's  yielded  by  this  phase  of  investigation, 
it  is -well  to  briefly  consider  some  of  the  difficulties  posed.  Sssentially, 
these  devolve  about  the  source  and  validity  of  the  available  criteria 
themselves. 

First  and  forerriost,  vje  raay  ask  what  it  is  that  oar  peer  rating 
technique  should  give  as  by  v.h.y  of  laeaningful  information?  '’.Jhile  not 
perhaps  the  complete  answer,  presumably  v;e  desire  an  adjunct  to  our  other 
measures  in  predicting  some  future  performance.  Given  this  adjunct,  v;e 
may  predict  more  efficiently  and,  perhaps,  screen  early  in  training.  But 
the  future  perfonmxnce  mg  be,  as  here,  a  two-stage  affair,  at  the  very 
least.  iCLl  of  which  is  by  way  of  suggesting  that  we  are  concerned  with 
both  performance  ^  OCJ  training  and  porfonriance  .ifter  0G3  training — and 


i' 


x-iiat'  tnu  ocnuvaor  V'l'iien  is  doiiii.nded  ana  vaxucd  at  tneso  t-vio  levels  niay 
be  quite  disparate. 

In,  this  study  v;o  have  used  fo.;r  b.a.,ic  peer  nomiaiation  forras;  each 
is  deslrp'.ed  t(..  foous  attention  on  some  Jog;.iont  of  ol.served  or  sedondarily 
e:ctra;'0.'..ited  behavior  which  has  a  bearing  or.  o.oe  or  b>oth  criterion  levels. 
The  "futare  officer"  (FO)  fo.oii  i-  aesif^ned  to  oroviiie  .a’ediction  of  long- 
range  performance  with  the  assu/ii’.jtion  that  the  pool  of  raters  \iill  integrate 
ii'ipressionr.  so  as  to  weight  a  variety  of  currently ,  observed  characteristics 
in  generating  a  judgitient.  The  other  forms  are  more  proxiia.l  in  ti;ae  and 
more  specific:  the  "leadership  qualities"  (LQ)  form  strikes  at  a  set  of 
interpersonal  behaviors  which  me,y  have  relevance  to  first  level  criteria, 
but  are  more  likely  to  have  relevance  to  second  level  performance  as  an 
officer 5  thu  "interest  and  enthusiasm"  (IE)  fom  is  considered  two-pronged 
in  that  it  has  applicability  at  both  criterion  levels;  and,  the  "success 
in  eXJS"  (OC)  form  is  quite  openly  aimed  at  first  level  predictions,  i%'ithout 
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Kxcludimj  pobbiuilitieb  at  tht;  later  lovela.  Kone  of  these  expec¬ 
tations  '..•.ust  necessai-ily  holdj  this  is  to  be  determined. 

The  matter  of  ti:iio  appears  to  be  of  sini'ular  import.  Uependin,"  ui>on 
which  of  these  forms  one  considers,  there  is  a  difference  in  the  optimum 
point  at  which  a  reading  mi.'jht  be  taken.  Thus,  by  way  of  exaiaple,  the 


OC  form  has  less  and  less  utility,  as  regards  validity  against  fin..i 
0C3  academic  average,  the  la+.er  in  training  one  secures  a  readin-;.  This 
follows  from  the  likelihood  tViat  this  form  will  huve  a  progressively 
greater  academic  performance  loading  with  time.  Clraucs  thcmiselves  v/ould 
very  likely  do  as  well’.  Therefore,  the  inaxiimuu  worth  of  the  X  form, 
for  first  level  prediction  and  subsequent  screening,  lies  in  its  earliest 
possible  administration,  before  raters  have  h.iu  an  abundant  input  of 
academic  performance  data.  This  is  predic.itoJ,  h-r.ever,  on  she  assojoption 
that  so..;o  significant  predict l.ility  is  aY;ii..blo  ar,  .n  '-arl,/  stage, 


o.g.,  orientatior:  v.'oea . 

regard  zc  other  forms,  lik,  leaders:!;  ai.lities  (L’-,),  v:e  may 
be  misled  should  v/e  focuj  sole  .itter.tion  on  its  p-rediction  of  tils  same 
criterion,  i.e.,  fin  :1  Odd  .ic.siemic  .'.v-.r  i.’c.  in  ieu  i,  it  m  .y  be  ruggested 
th;l  if  ohis  ferm  is  to  do  its  job  in  taj.,.'ing  rei^.v-nt  inter;.)erson_i 
behaviors  it  o  w-ht  to  b;;  mlniraully  correlu,ted  vath  acad..".ic  performance. 
F'arthermcre,  it  reir.  Ins  to  be  seen  ’whothe"  an  early  rearing  of  this 
me  ..sure  is  necessarily  the  best. 

3o  far,  we  h  ive  oriented  our  discussion  about  .lo.idemic  performance 
as  a  first  stage  criterion.  There  are  two  others,  however,  which  may 


l;e  -utilized:  these  are  final  XS  lailitary  aptitude  grade  and  the  tradi¬ 
tional  pass-fail  criterion.  V/e  have,  in  fact,  studied  prediction  of  all 
three  of  these  criteria.  It  is  presmied  that  the  lailitary  aptitude 
criterion^ — based  upon  ratings  assigned  by  Naval  Officers  in  charge  of 


peri'onnance  on  the  drill  field,  ut  insp-^clion,  Vind  so  forth— is  more 
likely  to  approxiaiate  the  second  stage  criterion  than  is  academic  average. 


V. Since  the  pass-fail  criterion  embodies  both  aoiideinic  and  strictly  jalli- 
tary  corisiderations,  it  reflects  a  composite  of  the  differential  emphasis 
of  these  two  criteria,  with  an  evident  loading  in  the  acadoirtc  direction* 
At  this  point,  then,  it  will  not  be  possible  to  saake  absolute  state¬ 
ments  about  the  validity  or  utility  of  the  various  forms.  Bound  as  we 
are  to  first  stage  criteria,  v;e  cannot  dismiss  any  form  as  "invalid” 


without  u  consideration  of  its  validity  against  a  second  stage,  i.e., 
fleet  performance,  criterion.  The  results  to  be  discussed,  therefore, 
are  not  final  but,  of  necessity,  tentative.  -  Further  v;ork  v.lth  post- 
trainin.;  criteria  should  provide  a  f;.lior  picture. 

A.  desalts  and  discussion  ' 

Table  III  centers  upon  prediction  of  tlio  p.....is-f  dl  criterion, 
iae.ir  ,.,ecr  no..iiri  A.ion  sn'ores,  oir  ti.o  varic  ;s  for-.i.;  and  sots,  have  been 
caic'ulited  fr.'.a  three  stages  for  those  subjects  v;ho  'were  aefined  as 
“failures."  Characterisation  of  an  individual  as  a  “failure"  is  gross, 
at  best]  it  is  not  ili.'ays  ijossible  to  a..ct’rtain  tl.s  uriieiue  laotivational 
or  situational  factors  invol.ved.  Thus,  v.'o  h..ve  ariltrarily  considered  : 
those  people  "fai-lures"  vfno  wore  involuntarily  disenrollad  from  .0C3  by 
board  action.  This  criterion  excludes,  therefore,  those  few  individuals 
who  voluntarily  withdrew  or  who  v/ero  dropped  for  medic..!  reasons. 

In  vievlng  Table  Ill,  it  is  important  to  recall  that  the  peer 
nomination  scores  are  based  on  a  mean  of  50  and  an  ap]>roxiinate  standard 
deviation  of  10.  Thus,  the  lower  the  mean  score  for  failing  subjects, 
the  more  effective  is  the  prediction  of  failure. 

It  vdll  be  aeon  that  the  N's  involved  are  quite  small,  particularly 


for  the  three  secondary  foruis.  Koroover,  since  initial  attrition  occ\irs 


TABLE  III 


Mean  Scores  Obtained  by  Failint/;  Subjects  on 
Ei"ht  Peer  Nomination  Forms  at 
Various  Stages  of  Training 


V/eek  in  Training 


1  Forms  and 
j  Sets 

Orientation 

Week 

Third 

V/eek 

SLcth 

Week 

i  FO-HO 

ii2/22- 

22/22 

24/15 

i 

’  FO-AU 
»  -  _ 

itS/30 

42/30 

40/22 

(  IS-RO 

jj 

i2/6 

il2/6 

42/4 

n 

20/13 

.  48/13 

42/10 

1  OC-iRO 
i 

ii^6 

^'6 

14/5 

1 

5  GC-AU 
{ 

^12 

21/42 

22/8  j 

r  “  . -  ■ 

i  Li-RO 

l< 

42/10 

24/6  1 

1  LQ-AU 

4§/5 

4^5 

W4  j 

^'The  number  after  each  mean  indicates 
the  N  upon  v/hich  it  is  based. 


TABLE  Ula 

Sunmry  of  Analysis  of  Variance  for  Table  III  with 


Assumption  of  One 


•  Source 

Sum  of  Sauares 

(l)  Form 

938 

3 

(2)  Time 

613 

2 

(3)  Set 

145 

1 

(4)  F  X  T 

258 

6 

(5)  T  X  3 

51  ' 

0 

(6)  F  X  S 

14 

3 

(‘7)  Residual 

11 

_6 

TOTiiL 

2030 

23 

Case  Per  Cell 


Mean  Square 

F 

312.67 

7.27  -  from  (4| 

306.50 

7.93  from  (lMsI 

145.00 

5.69  Ksfrom  (53 

43.00 

23.50  <«--§rom  (73 

25.50 

13.93  .. 

L.6?  , 

2,55  NS  "  :  , 

1.83 

*  5$  Level 
-rfif  Level 

NS  Not  Significant 
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after  the  end  of  the  fourth  week,  the  M's  for  oricintation  week  and  the 
thirci  week  are  identical,  vdth  a  drop  in  N  at  the  uixth  week. 

To  gain  an  overviev;  of  the  relationships  at  play  in  Table  13.1,  an 
analysis  of  variance  was  coii:pleted  and  is  aui,iiiiari'.4iid  in  Taolc  Ilia.  The 
liioiting  feature  of  this  analysis  wac-  the  as3u;;ii.vtion  of  one  case  j^or  cell, 
necessitated  in  part  by  the  small  and  variant  H's  involved,  ouch  an 
analyois  diminishes  degrees  of  freedom  considerably  anti  hence  reduces 
pov/er.  On  the  other  hand,  more  marked  differences  are  de;:tanded  to  yield 
significance^  thus,  F's  which  arc  significant  jn.y  bu  cansidcred  to  eo  so 
under  a  handicap.  Beyond  this,  it  is  also  true  th.it  t’-w.'  intercorrelation 
of  FC  with  the  other  foncs  operates  as  still  another  li;  .iting  factor. 

The  analysis,  therefore,  is  highly  conserv.itive  in  the  direction  of 
rendering  non-significant  findings. 


Study  of  Talle  IIIu  reveals  that  the  inuepondent  effect?,  of  form  and 
time  of  aa.; anistratio!!  are  significant:  this  is  not  t'.e  c-.isc,  hovrever, 
for  set.  In  this  connection,  though,  the  inter.-ctions  of  focis  x  time  and 
s.jt  X  ti.iC  are  significant,  this  l.itter .r.ict  indicating  tint  set  does 
provide  in  effect  ever  time,  considerin'-,  the  limit. itions  noted  above,  thei 


set  slnul  I  not  be  totally  dismissed  in  the  priciicti  .-n  of  thi..  criterion. 

Two  general  trends  are  worth  pstiiig  here:  prediction  tends  to 
improve  for  .all  for/as  viith  a  Later  time  of  ad:.uni£tratio;i — particularly 
from  the  orientation  w  ;ok  to  thi.rd  week  levels;  and,  the  OC  form  stan.'is 
out  jis  a  consistently  better  predictor.  In  lig'.  t  of  the  uiit...!!  h's, 
hovjover,  no  attem;.rt  has  been  maale  to  test  the  statistical  significance 
of  mean  differences  within  this  Table  Ill  except  for  FO;  in  this  instance, 


no  significance  is  found  between  FO-IiO  and  FO-AU  at  any  level,  but  third 
■and  sixth  week  scores  are  significantly  lovier  (i.s.,  better)  than 
orientation  vreek  raatings,  vihile  not  differing  from  one  another  significant! 


The  prediction  of  a  related  criterion,  i.e,,  final  OCS  academic 
average,  is  considered  in  Table  IV.  As  has  been  foreseen  in  the  fore¬ 
going  Section,  a  geiieraliaed  increase  in  the  laagnitude  of  correlation 
between  forms  and  the  academic  criterion  is  to  be  found  over  time.  Further¬ 
more,  while  varying  considerably  in  niagnitude,  the  coefficients  are  sig¬ 
nificant,  in  the  main. 

For  the  purposes  of  testing  the  differential  effects  of  the  variables 
involved,  the  coefficients  for  the  first  three  columns  (thus  omitting 
FO-RO  and  FO-AU  for  the  thirteenth  week)  were  all  transfonaed  to  Fisher's 
z  and  subjected  to  analysis  of  variance.  Once  having  nonaalized  them  in 
this  fashion,  one  may  treat  coefficients  as  any  other  numbers.  This  does, 
of  course,  obscure  the  N's  involved  in  their  determination  and  leads  to 
the  limitatiori  of  degrees  of  freedom  and  analytic  power.  The  consequences 
of  "his  conserv-tive  approach  have  been  considered  above. 

The  F's  in  Table  IVa  parallel  those  cetermined  in  connection  uith 
the  pass-fail  criterion  (cf.  Table  Ilia),  Form  and  tiuie  yield  significant 
independent  effects j  set  does  not.  h'ith  regard  to  interaction  effects, 
once  again  the  form  x  tiine  interaction  is  a  significant  one.  In  contrast 
to  the  previous  table  cited,  it  is  not  time  x  set  interaction  which  is 
significant,  but  fonsi  x  set.  The  genesis  cf  this  may  be  sougb.t  through 
study  of  Table  IV.  ’  . 

Speaking  to  this  point,  one  of  the  features  of  'this  basic  table 
is  the  pattern  of  differential  validities  to  be  found  for  the  two  sets 
vdthin  the  IE  and  LQ  forms.  In  the  former  case,  the  "administrative" 
set  yields  higher  r's  than  does  the  "research”  set  (II) j  in  the  latter 
case  the  inverse  jiattern  is  found  (LQ).  For  both  the  IE  form  and  the  LQ 


form  these  differences  are  consistent  and  significant.  One  may  conjecture 
about  these  IE  and  LQ  patterns  since-taking  account  of  the  similarity  of 
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T/vBLE  IV 


Validity  Coefficients  Against  Final  0C3  Acudeinic  Average  for 
Eight  Peer  Nomination  Forms  at 
Various  Stages  of  Training 


Week  in  Training 


Forms  and 
Sets 

N 

Orientation 
[  Week 

Third 

Week 

Sixth 

Week 

Thirteenth 

Week 

FO-RO 

349 

■Bi 

■Hi 

.47^H' 

FO-AU 

320 

B 

■H 

.  41^'**' 

lE-RO 

119 

,05 

.22-::- 

.16 

IB“A'u 

116 

.30--' 

OC-RO 

112 

.31'''""' 

.73iK^ 

0C-.'i.U 

82 

.32^- 

.11^ 

LQ-RO 

118 

.29-^-;;- 

.54-:h:- 

j  Lv^  AU 

122 

.10 

.2>:t 

.25-' 

Level 

Level 


TABLE  IVa 


Suiwnary  of  Analysis  of  Variance  for  Table  IV; 
Follovdng  a  Transformation  of  Validity  Coefficients  7^ 
against  Final  Acadejidc  Average 


•Source 

Sum  of  Squares 

df 

Mean  Square 

P 

(l)  Form 

9678 

2 

3226 

6.16  1 

From  C4)&(6| 

(2)  Time 

5662 

2 

2831 

6,31*  1 

From  (4J 

(3)  Set 

3 

1 

■3 

— —  NS  1 

^rom  (6| 

(4)  F  X  T 

2692 

/ 

U 

449 

10 . 20  ■'''**■  1 

Fi'ora  (?! 

(5)  T  X  S 

3 

2 

4 

- NS 

*1 

(6)  F  z  3 

2021 

3 

674 

16.32 

(7/  Residual 

264 

6 

44 

TOThL 

20328 

23 

/  The  decimal  point  for  the  a ' s  ^  %  Level 

has  been  disregarded  in  this  !;«  Level 

analjrsis,  NS  Not  Significant 
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sstf!  for  FO  anri  0C~these  are  the  evident  source  of  the  3ii;nificant 
form  X  set  interaction  just  noted.  For  the  moment,  it  jnay  be  hyijothesized 
that  in  both  instances  the  adininistrative  sot  jdelds  all  that  one  might 
expect  of  the, form.  Thus,  a  "good"  LQ  form  presumably  should  have  a  low 
loading  with  academic  performance,  and,  similarly,  a  "good"  IE  form— if 
it  taps  motivation — should  have  a  somewhat  higher  loading  with  ucadeirdc 
performance.  This  is  the  picture  w  find  for  the  forms  administered 
uiider  the  AU  set.  It  is  not  necessarily  the  sole  explanation,  however. 

One  sign  which  to  some  degree  contraindicates  the  above  hypothesis, 
is  the  hi.gh  correspondence  betv/een  OC-rtO  and  OC-.il  validity  coefficients 
over  time.  The  for.m  :>dclds  a  high  validity  under  both  sets.  It  '..'ould 
appear,  then,  th  it  the  set  differences  are  unique  to  foia.i.  wore  considera 
tion  of  this  point  will  be  vindertaicon  below,  .vt  the  laoinent,  how'KVer,  it 
Tray  bo  said  th.at  the  OC  form — taken  over  tii.io — afi'erds  better  prediction 
th.iH  any  of  the  other  for...;);  thi-.  au.njriority  is  si 'nificant  at  the 
level.  Further,  it  eceords  i.-ell  with  the  i'inuin, -a  of  the  iireceJirg 
analysis.  It  m-y  r.e  nAod,  too,  that  third  and  sixtl;  v.wiok  ;)rudictions, 
by  fora,  w'ire  once  a 'ain  .••eriei' diy  C'.’.up  .rJyie  an.i  si.'-.nifioaatly  different 
from  par  iiiel  orientatioii  weex  ]-roaictions. 

Foi-lov'ing  on  tlic  validity  coefficient  analysis  v.'iuh  final  academic 
avora;,e  as  a  criterion.  Table  V  presents  validity  coefficients  using 
military  .aptitude  grade  as  a  criterion.  It  ;dll  be  noted  that  all  of 
these  are  signiiacant  •■y''nrl  the  1^  level,  which  sa,ys  effectively  that 
peers,  in  their  evaluations,  respond  positively  to  qualities  which  are 
seen  by  military  instructors  as  important — and  do  so  very  early  in  train¬ 
ing,  i.e.,  orientation  v/eek.  Previous  work  in  this  vein  (a)  has  led 
to  the  belief  th’at  soiae  general  set  of  interpersonal  cha.-acteristics  are 


involved  which  both  peers  and  superiors  acknowledge  as  desirable. 


¥alid 


i/,i— All 


S'-mrary  of  Analysis  of  Variance  for  Table  V:  '  ^ 

Follov/ins  z  Transformation- of  Validity  Coefficients 
Against  I'iilitary  Aptitude  Grade 


Source 

Sum  of  Souares 

Si 

Mean  Square 

F 

(1)  Form 

524 

3 

174.7 

5.C2 

^rom 

(72 

(2)  Time 

39o 

198,0 

5.69 

11 

•'(3)  Set 

0 

.1 

0 

- Kd 

M 

(4)  F  X  T 

21' ■ 

6 

36.2 

- NS 

W 

(5)  T  x'3. 

31 

'> 

15.5 

- NS 

11 

(6)  F  X  S 

4'^1 

3 

157.0 

4.51  NS 

M 

(7)  Residual 

209 

•  J. 

34.3 

TOTaL 

1348 

23 

/  The  decimal  point  for  the  z's 
has  been  dis'egarded  in  this 
analysis . 


*  5/6  Level 
NS  Not  Significant 


In  accordance  with  the  analjitic  procedure  for  Table  IV,  the 
coefficients  here  wore  transformed  to  z's  and  subjected  to  an  ;j.nxlysis 
of  variance,  reported  in  Table  Va.  Study  of  this  reveals  significant 
independent  effects  traceable  to  form  and  time.  Neither  sut  nor  any  of 
'the  interaction  effects  are  significant. 

Returning  novi  to  Table  V,  it  will  be  rioted  that  the  orientation 
rifeek  I'eading  is,  in  general ,  less  predictable  than  the  third  week 
reading  or  the  sixth  week  reading;  as  before,  these  latter  tv/o  readings 
are  not  significantly  different  from  one  another.  In  terms  of  comp/arison 
of  forias,  LQ  is  a  significantly  batter  overall  predictor  of  this  criterion' 
than  iu  OC. 

From  a  somewhat  different  viev.’i'oint,  still  another,  question  of 
validity  concerns  the  relationship  of  deer  no.'dnation  scores  to  basic 
intellectual  factors,  dariy  in  training,  the  subjects  of  our  study  : 
routinely  took  the  Officer  Classi  fication  battery  (OCJ)  v.'liich,  yields 
five  scores;  the  tv.'o  v/hich  mo^t  concern  us  here  are  Vorbal  and  Math. 

For  this  sa;.iple,  they  have  r’s  viith  fin-.d  ac.idemic  average  which  are 
,40  and  .5fi  respectively.. 

In  Table  VI,  r's  are  given  between  the  Verbal  and  kath  scales 
and  the  peer  nomimition  scores  obtained  from  forms  aeJministered  under  the 
two  sets  at  different  trie  levels.  One  is  imiaediately  struck  b.,  the  paucit,; 
of  significant  relationships  between  these  tv/o  intellectual  measures 
and  the  orientation  week  peer  nominations.  It  is  noteworthy,  too,  that  a 
progressive  increase  in  significant  r’s  is  seen  as  one  proceeds  to  the 
next  time  levels.  Such  a  finding  is  not  surprising  in  view  of  previous 
evidence  and  discussion  regarding  the  contaminating  influence  on  peer 
nominations  of  academic  performance  data. 
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.  TABLE  FI 

Relationship  of  Eight  Peer  Nomination  Forms 
Obtaineti  at  Various  Stages  of  Training  to 
Verbal  and  Hath  OCB  Scores 

TjjHBAL 


Week  in  Training 


1  Forms  and 

1  Sets 

i-. 

Third 

V/eek 

1  Sixth 

Week 

Thirteenth 

Week 

FO-RO 

349 

-.01 

IBEBIIII 

.  18‘”<''<’ 

FO-AU 

32G ' 

.06 

HBH^ 

wm 

.IT"""'" 

lE-no 

119 

-.09 

-.11 

-.20-::- 

'  lE-AU 

116  . 

.20’"' 

wm 

■gi 

•  OC-HO 

ns 

■BsHI 

OC-A'i 

82 

0  •t* **4 

— 

Ki-HO  : 

_ _ _ j 

HQII 

.17 

LQ-.-iu  1 

SbS 

.06 

»o6 

K-vTH 


i/eek  in  Traiijing 


Forms  and  J 
Sets  1 

N 

Orier.tation 

v;'eek 

■  Third 

Week 

Si:cth 

t’eek 

Thirteenth 

V.’eek 

FO-RO  1 

349 

-.10 

miRB 

,23‘'’“''' 

FL>-.-ViJ  1 

320 

-.01 

mm 

.22-::'"- 

i 

lE-RO  1 

119 

-.03. 

.11 

.07 

lE-AU  1 

116 

.11 

.16 

.11 

OC-10  1 

112 

.10’ 

.41^^^ 

OC-AU  1 

82 

.05 

.52’«> 

L(i-R0  1 

118 

.00 

.13 

.19^" 

LQ-AU  1 

122 

-.01 

.09 

.14 

, 

*  5/6' Level 

**  1%  Level 

J 

I  . 


» 


illuininatin*',  among  the  multifarious  relationships  maxiifasted 
here,  is  the  fact  that  neither  PO  nor  LQ — the  two  forms  seftn  as  more 
long-range  predictors — reflect  nearly  so  high  a  rolationahiu  vdth  cither 
scale  as  doss  OC,  the  more  lii.dted,  in-training  predictor.  Furthermore, 
it  is  important  to  call  attentiun  to  the  fact  that  OC,  v;hich  predicts 
the  final  academic  criterion  significantly  at  tiie  orientation  week  level 
(cf.  Table  IV),  doss  not  bear  a  significant  relationship  to  the  tlath 
scale  at  this  level  and,  while  significant  in  relationship  to  the  Verbal 
scale,  under  the  ali  set,  it  is  not  near  the  magnitude  it  attains  by  the 
sixth  week.,  Svidenti;'’,  then,  certain  of  the  non- intellective,  personal 
factors  associated  vdth  academic  p-srfoimance  are  being  measured  by  the  OC 
form  even  at  this  level . 

Returning  to  the  discuDsi',in  undertakon  in  connection  vdth  Table  IV, 

Vv'e  may  aov;  further  consider  the  '-Jiscre:-  incy  betv.aon  the  .p'rodlotion  of  the 
academic  criterion  yielded  by  lii-kO  as  opp  osed  to  1K-hu,  Ta!>Ie  VI  provides 
some  illm:iin.-.tion  of  the  liaely  factors  unneriyin;;;  this.  It  v.dll  bd  noted 
that  Ili-iiO  manifests  a  progxfcssively  inore-isir.g  n-e.-ativc  relationship  .dth 
the  Verbal  scale  of  OCb;  t'sis  ■.■•attern  is  inverse  fox’  Ijxh.vu,  at  tv/o  tiirie 
levels.  Since  no  comparable  differences  are  to  be  foiind  in  tlie  respective 
relationships  of  these  sets  of  IE  with- the  Math  soole,  it  would  seem  fcLxit 
verbal  skills  largel,y  account  for  the  differences  in  prediction  of  the 
ac.alemic  criterion  afforded  b^  th''  Tlrus.  it  follov/s  tliat  the  less 

verba  lly  facile  individuals — if  v/e  iray  assume  a  behavioral  correlate  of 
Iovj  Verbal  scores — are  being  perceived  as  more  motivated,  i.e,,  "interested 
and  enthusiastic."  it  might  be  said,  therefore,  that  they  are  thus  the 
recipients  of  a  "boost"  from  their  pcei'S.  Yet,  this  is  what  ^ne  would 
more  likely  expect  under  an  "administrative"  set  where  nominations  may 
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have  real,  or  presuuned,  impact  on  the  n(j;iiinee'3  statuu.  The  fact 
that,  to  the  contrary,  this  occurs  under  the  "research"  set  could  lead 
to  the  '.dew  that  the  AU  .set  is  to  be  preferred  for  prediction  when 
utilizing  the  IE  form.  There  arc  those  v;ho  could  argue,  hov/over,  that 
the  negative  relationship  bet^/cen  lE-ilO  and  the  Verbal  scale  implies 
a  "purer"  measure  of  motivation  than  that  obtained  where  a  positive 
relationship  is  found,  as  in  the  case  of  IE-.a'j.  This  tan. 'enti.u  issue 
remains  to  be  resolved.  • 

XI.  Conclusions 


Taken  together,  ’the  finding's  obtained  for  the  prediction  of 
in-trainitvj  criteria  le...d  to  the  central  conclusion  that  peer  noiiiina- 
tiens  do  aiocriuiin.ite  .icte.^istios  and.  do  '.yield  varying  valid¬ 

ities.  hirferent  forms,  therefc-e,  m.ay  be  considered  to  provide  unique 
vievjs  of  t’U:  individuil.  .is  reg.-.rds  any  substmtiai  diii’e;-.;ncus  attrib- 
ut.able  to  set,  the  evidence  is  esscnti.illy  non-confim  d: 

'For  the  prediction  of  academic  i-erfonmuice,  no:,;in..tions  on  "success 
in  0C3"  at  Llie  orientation  '..’ae;:  lev.d  arc  a’i  •nii’icaiit.  rhis  is  certainly 
v.'orth  notin;' — p:irtic..’.l  it'l.,  sine-  suha  .-.c-or-'S  .ire  uovoi.!  of  ril.aicroom 
impressions  and  have  a  lo'-:  rclationoizip  to  the  Verb;!  ini  hath  factors » 
There  is  reason  to  believe  thj.t  the  "leade."ship  q.i.ilitios"  icri.',  too, 

CO' lid  be  profitai.'ly  utili'se-.  G-uray  in  tMiaing  in  order  t  >  ob^  ein  a 
viev;  of  the  individual  which  is  rolativel./  free,  of  academic  conta;  ination 
The  same  j'cssibility  exists  for  the  "future  officer"  form. 

In  terms  of  the  time  dimension,  the  available  evidence  indicates  a 
clear  increa.je  in  the  correlation  of  peer  nominations  with  academic  per- 


fox-mance  from  3t:.i"(;  to  stage.  Itelated  to  this  point,  hov/ever,  is  the 
consideration  tha-t  third  w<;ek  ratings  yield  a  reassnaljle  ajjproximation 
to  sixth  week  ratings.  To  effceLa.wl.,  ..linimire  r-’.nf;.Mnn>atdon  effects. 


then,  it  v/ould  seen  desirable  to  ’ase  peer  nondnatione  at  the  third 
\';eek  level  and  perhaps  earlier. 

Although  these  findings  do  illaminate  jxiths  of  apjjlication,  they 
are  tentative  J  Without  data  bearing  upon  post-training  perfomance, 
any  broad  generalization  from  there  raust  be  approached  with  caution. 
This  is  not  to  be  considered  the  last  word,  i'/ith  the  procuremont  of 
more  ultiaato-. criteria  these  findings  should  be  set  on  firmer  ground. 
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APPENDIX  A— fOHl-i  FO-ftO 

U.  3.  MVaL  school,  OFFICEil  CANDIDATE 
NEWPORT,  ItHODE  I3L.aJD 

You  have  been  together  with  the  men  in  this  room  since  you  entered  OCS. 
From  this  contact,  you  will  have  formed  certain  impressions  of  them  regarding 
their  future  success  as  Naval  Officers, 

Considering  these  impressions,  and  carefully  vieighing  the  qualities 
required  in  a  successful  Naval  Officer,  you  are  to  select  the  five  members  of 
your  section  whom  you  consider  to  have  the  hif-hest  promise  as  Naval  Officers, 
and  the  five  members  of  your  section  whom  you  consider  to  have  the  lowest 
promise  as  Naval  Officers.  ■ 

THE  REoJLTo  OF  THE3E  UATING3  ..  ;E  TO  Iffi  U3ED  FOR  RESSulCH  PURPOoES  ONLY 
iMid  WILL  NOT  AFFECT  YOUR  N.iVY  C.AREER. 

Specifically,  you  are  to  perform  these  exact  operations: 

1.  Consult  the  section  roster  which  has  been  provided  you  and 
draw  a  line  through  your  a\m  name. 

2.  Study  the  remaining  names  on  the  roster  and  seD.ect  the 

individual  with  the  hl;;hest  promise  of  succes  ^  .li  i'<aval  Officer « 

Enter  this  natne  in  the  space  labeled  H-1  below  and  then  drav.'  a  line 
through  that  name  on  the  roster. 

3*  Study  the  roster  again  and  then  select  the  individual  with  the 
lowest  promise.  Enter  this  name  in  the  space  l.ibeled  L-l  below  and 
(then  draw  a  line  through  that  nruno  on  tlie  roster, 

4.  Continue  the  study  of  this  rooter,  .ilternatsly  selecting 
indi\d.du.als  with  the  highest  promise  and  the  lowest  promise,  until 
you  have  entered  ten  na:ies.  Drav,  a  lira;  throufRi  each  na::ie  on  the 
rooter  as  you  write  it  in  the  proper  pl  ic-e  herso 


HIGHE3T  PR0M13E _ K-1 

_ ^H-2 

_ H-3 

' _ H-4 

_ H-5 


>5 

L-4 


>3 

I/-2 


LOWEST  PROMISE _ 'L-l  ■  i|; 

■  ■  :1t 
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